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Abstract. 

This work aims to explore the regularity properties of the smoothed-TV 
regularization for the functions is of the class Holder continuous. Over some compact 
and convex domain U, we study construction of multivariate function y>(x) : C R 3 —>• 
M+ as the optimized solution to the following convex minimization problem 

argmin n j F a (-,f s ) := i||T(-) - f\\u + aJ(-)| , 
where the penalizer J(-) : C 1 (fl,R 3 ) —>• R+ is the smoothed total variation penalizer 

J(') = [ \/11 V(-) 1+ /3dx, 

J n 

for a fixed 0 < /? < 1. We assume our target function to be Holder continuous. With 
this assumption, we establish relation between total variation of our target function and 
its Holder coefficient. We prove that the smoothed-TV regularization is an admissible 
regularization strategy by evaluating the discrepancy \\Tip a — / 5 || < t6 for some fixed 
r > 1. To do so, we need to assume that the target function to be class of C 1+ (fl). From 
here, under the fact that the penalty </(•) is strongly convex, we move on to showing 
the convergence of \\p a ~ v^ll, f° r Va is the optimum and tp* is the true solution for 
the given minimization problem above. We demonstrate that strong convexity and 
2—convexity are actually different names for the same concept. In addition to these 
facts, we make us of Bregman divergence in order to be able to quantify the rate of 
convergence. 

Keywords. Holder continuity, Bounded variation, smoothed total variation, 
Morozov discrepancy. 


1. Introduction 

As alternative to well established Tikhonov regularization, [26, 27], studying convex 
variational regularization with any penalizer J(-) has become important over the 
last decade. Introducing a new image denoising method named as total variation , 
[28], is commencement of this study. Application and analysis of the method have 
been widely carried out in the communities of inverse problems and optimization, 
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[1, 3, 4, 8, 9, 10, 14, 15, 31]. Particularly, formulating the minimization problem as 
variational problem and estimating convergence rates with variational source conditions 
has also become popular recently, [7, 18, 19, 20, 25]. Unlike in the available literature, 
we define discrepancy principle for the smoothed-TV regularization under a particular 
rule for the choice of regularization parameter. Furthermore, still with the same 
regularization parameter, we manage to show that smoothed-TV regularization is an 
admissible regularization strategy with Holder continuity. 

We are tasked with constructing the regularized solution ip a over some compact 
and convex domain Q C 77, for the following variational minimization problem, 

<P<*(6) eargmin^j F a (ip, f s ) := ^||7> - PW^ + , (1-1) 

for the penalty term J(<p) : C 2 (11,77) — > M + defined by 

J(<P) = [ J\\V<p\\ 2 2 + Pdx, (1.2) 

Jn 

and a > 0 is the regularization parameter. It is expected that the perturbed given 
data is f s ^ 7 Z(T) lies in in some S— ball B$(p) centered at the true data p, i.e. 
\\P — f s \\ <8. The compact forward operator T : hi C 77 —> PL is assumed to be linear 
and injective. It is well known by the theory of inverse problems that a regularization 
strategy is admissible if the regularization parameter satisfies, 

«(£, P ) = sup {a > 0 | || T(p a (S) ~ P II < r8}, (1.3) 

where r > 1, [16, Eq. (4.57) and (4.58)], [24, Definition 2.3]. The regularized solution 
tp a ( 5 ) °f the problem (1.1) must satisfy the following first order optimality conditions, 


o V FaiSPa{6)) 

0 = T*(7> q(5) - p) + a(5)V J(<p a{ 5)) 

T*(P - Tip a (s)) = a(5)VJ(<p a{s) ). (1.4) 

This work aims to answer two fundamental questions in the held of regularization 
theory; Is it possible to quantify r in (1.3) when the penalizer is (1.2)? What is the rule 
for the choice of regularization parameter a (8, f s ) when the penalizer is (1.2) that the 
smoothed-TV is also an admissible regularization theory? We will be able to quantify 
the rate of the convergence of ||^q(< 5 ) — 11 by means of the Bregman divergence. 

Existence of the solution to the TV minimization problem, i.e. J(-) = f Q ||V(-)|| 2 <ir 
in the problem (1.1), has been discussed extensively [22, 29]. Moreover, an existence 
and uniquness theorem for the minimizer of quadratic functionals with different type of 
convex integrands has been established in [11, Theorem 9.5-2], As has been given by 
the Minimal Hypersurfaces problem in [13], the minimizer of the problem (1.1), for the 
smoothed-TV penalty </(•) = f Q \/||V(-)11| + (3dx, exists on a reflexive Banach space. 
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2.1. Vector calculus notations 


We assume to be tasked with reconstruction of some non-negative scalar f un ction defined 
on a compact subset hi of R 3 , i.e. (p(x) : hi C R 3 —> R + where the spatial coordinate is 
x = (x, y, z). Then the gradient of <p is regarded as a vector with components 



dtp 
dy ’ 


dp 

dz 



The magnitude of this gradient in the Euclidean sense, 


IIW|| 2 = 


dip 


dx 


+ 


dip 


dy 


+ 


dip 


dz 


1/2 


( 2 . 1 ) 


2.2. Functional analysis notations 

We aim to approximate a function which belongs to Holder space. Holder space is 
denoted by C 0 , 7 (fl) where 0 < 7 < 1, [17, Subsection 5.1]. If a multivariate function 
</>(x) G C 0 , 7 (fl), then there exists k > 0 such that the function <p(x) satisfies the following 
11 older continuity 

|</?(x) — 92(x) | < k \ |x — x| I2, Vx, x6fl. ( 2 - 2 ) 

Here | - | is the absolute value of p(x) : Q C R 3 —> R + . Holder space is a Banach space 
endowed with the norm 


II* : = IMI 00 + b]c0,7, 

where the Holder coefficient [(/ 2 ] c o. 7 (n) is defined by 

k(x) -*)| 


Mc°.T(n) : = sup 

x.xeOcK 3 


x — X 


and the Euclidean norm is 


2\7/2 


I l x - x l II : = ((z ~ Xo) 2 + (y- Vo ) 2 + (z- Zo) 2 ) 

So that, we define Holder space by 

C°’ 7 (f!) := {^eC(O) : |M| 7 < 00 }. 

In this work, we focus on total variation (TV) of a function, [ 8 , 
TV of our multivariate function is explicitly, 


(2.3) 


(2.4) 


(2.5) 


]. With (2.1), 


tvw = L |r ^ 2dx= L L L (O + (I) + @)) dxdydz ■ 

Total variation type regularization targets the reconstruction of bounded variation (BV) 
class of functions, [30], 

M\BV~M\c'+TV(ip). 


( 2 . 6 ) 
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Following formulation emphasizes the functionality of the Bregman divergence in proving 
the norm convergence of the minimizer of the convex minimization problem to the true 
solution. 

Definition 2.1 (Total convexity and Bregman divergence). [6, Definition 1] 

Let : PL —> M U {oo} be a smooth and convex functional. Then $ is called totally 
convex in u* G PL, if, for V<F(m*) and {«}, it holds that 

D$(u, u*) = <F(m) - $(«*) - (V<E>(w*), u - u*) ->■ 0 |\u - u*\\ n ->• 0 

where Dq,{u,u*) represents the Bregman divergence. 

R is said that $ is q-convex in u* E PL with a q G [2, oo), if for all M > 0 there 
exists a c* > 0 such that for all \ \u — u*\^ < M we have 

D<s>(u, u*) = $(u) - $(«*) - (V${u*),u-u*) > c*\\u — u*\\ q H . (2.7) 

Throughout our norm convergence estimations, we refer to this definition for the 
case of 2 —convexity. 

In fact, another similar estimation to (2.7), for q — 2, can also be derived by making 
further assumption about the functional $ one of which is strong convexity with modulus 
c, [5, Definition 10.5]. Below is this alternative way of obtaining (2.7) when q — 2. 

Proposition 2.2. Let $ : PL —» MU{oo} be $ G C 2 (PL) is strongly convex with modulus 
of convexity c > 0, i.e. V 2 < f> >- cl, then 

D§(u,v) > c||w — u || 2 + 0{\\u — u|| 2 )- (2.8) 

Proof. Let us begin with considering the Taylor expansion of <F, 

<E>(w) = < F(u) +(V < F(n), u — n) + i(V 2 < I)(u)(M — v),u— v) + 0(\\u — n|| 2 ).(2.9) 
Then the Bregman divergence 


D^(u, v ) = $(«) — $(d) — (V<f>(u), u — v) 

= (V<I > (u), u — v) + -(V 2< h(n)(M — v),u — v) + 0(\ \u — v\ | 2 ) — (V < h( 

= i(V 2< h(n)('U — v),u — v) + 0{\\u — u|| 2 )- 

Since $(•) is striclty convex, due to strong convexity and G C 2 {PL), hence one obtains 
that 


D$(u, v ) > c |\u — v\ | 2 + 0{\\u — v\ | 2 ), 


( 2 . 10 ) 


where c is the modulus of convexity. 


□ 
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We already have reviewed in Subsection 2.2 that the Holder space C 0,7 is a Banach space 
endowed with the norm, for all x j- y E Tl and is a compact domain, 

IMI 7 := SU P l^( x )l + fa]c°.-r(n) = IMloo + Mc«>.7(n)- (2-11) 


xES2 


Here the Holder coefficient is obviously bounded by 

fcWo, == SUP hhffihp < K . 


x,xGr2 


17 — 


Furthermore, following from (2.11), an immediate conclusion 
follows. 

Proposition 2.3. Over the compact domain 7, if <p e C 0 , 7 (f2), 
Proof. Since ||<p||oo > J^ill^llc 1 and [<p]co,->(n) > 0, then 


( 2 . 12 ) 

can be formulated as 
then <p e £ 1 (fl). 


IMI7 



IMU- 


(2.13) 

□ 


3. Holder Continuity and TV of a C 1 — Smooth Function 

We now come to the point where we start establishing the relations between 7 —Holder 
continuity and TV of a function <p on R 3 . The following theorems will also serve us 
for determining an implementable and unique regularization parameter appeared in the 
minimization problem (1.1). We emphasize a very important assumption that we always 
work with continuous function on a compact domain which is uniformly continuous. This 
fact will allow us to interchange the necessary operations in order to obtain the desired 
results in what follows. 

Theorem 3.1 (Morrey’s inequality). [17, Subsection 5.6.2., Theorem 4} Let fl C R^ 
be the compact domain and let N < p < 00 . Then there exists a constant C, depending 
only on p and N, such that 

IMIcO’-qo) 7 CIMIwi’P(n) (3-1) 

for all ip G C 1 (7), where 

7 := 1 - N/p. (3.2) 

Corollary 3.2. Specifically in R 3 , the theorem implies that 

b]c°'V 4 (n) 7 CHV^n), 

since 7 := 1 — 3/4. 


(3.3) 
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Theorem 3.3. Over the compact domain C R 3 , with its volume |fi| G R + , let 
ip G C 1 (f2) D C 0 , 1 /, 4 (f2). Then Holder coefficient [<p\co,i/*ki) of the function is bounded 
by its total variation TV((f) as such, 


Mc 0 ’ 1 / 4 ^) — 


r(0) 3 / 4 


TV(ip), where r(fl) := 


sup | |x — x 

x,xGfi 


Proof. Recall our vectoral notations in R 3 , x = ( x,y,z ) and x = ( x,y,z ). Then for a 
fixed 7 G (0,1], componentwise Holder continuity in R 3 is given by 


f \(p(x,y,z) - <p(x 0 ,y,z)\ 

1 <p{x,y,z) - (p(x,y a ,z)\ 

l ll x -x||I 

x _ x 2 


Mc°.-r(n) = SU P 

x.xeSici 3 


By the definition of Euclidean norm in (2.5), 

||x~x||2 > sup{|a; — 5 0 | 7 , \y - ?/o| 7 , \z - 5 0 | 7 }. 
n 


I- <p(x,y,z 0 ) | 


x — X 


So this implies 


b]c°.f(n) < SU P 

x.xGOcR 3 


\<p{x,y,z) - (p{x 0 ,y,z)\ | (p{x,y,z) - (p(x,y a ,z)\ 
\x~Xol 1 ’ \y ~ VoX 1 

I <p(x,y,z) - ip{x,y,z 0 )\ 
’ \z-Zo\-r 


= sup 


f 1 <p(x,y,z) 

0 

9- 

1 

, 11 , z) 1 \<p(x,y,z)-<p(x, 

Vo, z) I 

l 

\x — X Q \ 

a: — x Q \ 

<cf 

1 

0 

<cf 

1 

0 

7-1 


I <p(x,y,z) - ip(x,y,z„) \ 


Z — Zn\\Z — Z, 


17—1 


= sup 

x.xeOcR 3 


\<p{x,y,z)-ip{x 0 ,y,z)\. „ a \ip(x,y,z) - ip(x,y 0 ,z)\ 




\x x 0 1 7 , 


\y-Vo I 


■| y-Vo 


1-7 


W{x,y,z) -<p(x,y,z 0 )\^ z a _^ 

\z z 0 \ 


\z - Zo\ 

Here, the last equality in the chain is rather convenient to present since 7 — 1 < 0 < 1. 
Obviously, for any pair of points (x, x) G 0, there exists s > 0 such that s = ||x — x| I 2 - 
Then, 

r 1-7 > s 1-7 = | |x — x|| 2~ 7 > sup{|a: - £ 0 | 1-7 , |y ~ f/ 0 | 1-7 , \z - z 0 | 1-7 }, 

n 


we have 
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fa]c°. 7 (n) < sup 

x,xg!)CM 3 


I <p(x,y,z) -<p(x 0 ,y,z)\ \ 

1 <p(x,y,z) - (p(x,y 0 ,z) | 
\y - Vo\ 

I P{x,y,z) - (p(x,y,z 0 ) | 
\z - 5 0 | 



1-7 

2 


11!-7 
112 


11 1— 7 

I \2 


= sup 

x,x€f2cR 3 


X - X n 


< r 1 7 sup 

xieoci 3 


x - x 0 


1 <p(x,y,z) 

- <p(x,y 0 ,z )| ^ 


\y 

l ^ 

-Vo \ 

1 <p(x,y,z) 

~ <p(x,y,z 0 ) | 


\ z 

~ 1 
- z 0 \ 


x,y,z ) 

~ <p(x,y 0 ,z) | 


\y 

— S/o| 


x,y,z ) 



z - z n 


Recall that our function (p is continuous over the compact domain Q which makes it 
uniformly contiuous on the same domain. Then we are allowed to interchage lim with 
sup . Now, moving on to the limit on both sides with respect to each component lim x ^ io , 
lining and lim z _» 5o , 


[*>]*>, 


(Q) 


<^( II? , 


_ r l-7 


dip 


dip 

dy 




dip 

dz 


dx 

< 'r 1 _ 7 ||V (^|| 2 


dip 

dy 


1/2 


dip 2 
dz 


1/2 


Again, the last inequality has been obtained by the fact that sum of the components 
always remains greater than each component itself. Now, integrate both sides over the 
compact domain to yield 

r i—7 

(n) - "pf 

which is, to be more precise, 




W\ c°.V 4 (n) 


5 W TVM ’ 


since 7 = 1/4 in R 3 . 


□ 
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This shows that Holder coefficient of a function <p G C 1 (h2) D C 0,1//4 (fi) is an 
approximation for the total variation of the same function. In the following theorems, 
we will establish the reverse direction of this statement. To do so, we will make use of 
the Lipschitz continuity which is a specific case of Holder continuity in (2.2) for 7 = 1. 

Theorem 3.4. Under the same conditions of Theorem 3.3, for 7 = 1 in (2.2), 


||v^|Ui<K|n|. 

Proof. As we have introduced in the Section 2 by (2.1), 


l|V<p || 2 = 


dip 


dx 


+ 


d(p 


dy 


+ 


dip 


dz 


1/2 


< 


dip 


dx 


+ 


dip 


dy 


+ 


dip 


dz 


This inequality has been obtained by using the following simple identity 
(p + q + s) 2 = p 2 + q 2 + s 2 + 2 pq + 2 s(p + q) > p 2 + q 2 + s 2 , 


(3.4) 


(3.5) 


for p,q,s G M + . This implies 

p + q + s > (p 2 + q 2 + s 2 ) 1/2 . 


To arrive at (3.5), set p 11^| , q 


dip 

dy 


, and lastly s : = 


I dip I 
dz I 


Now by the definition 


of partial derivative in the componentwise sense, 


|| V (p || 2 < lim + lini I <p(x,y,z)~ip(x,y 0 , z)\ + 

— x-txo \x — x Q \ y^-yo \y ~ Vo\ 

+ lim I <p(x,V,z) -<p(x,y,z 0 ) | 

z^rzo | Z — Z Q | 

Gradient of the functional <p(x) over the compact domain is valid for any x G G fl. 
Therefore, we continue with our proof in the unified form. First observe that by the 
Lebesgue dominated convergence theorem, 


||V^(x 0 )|| 2 dx 0 < / lim 


J n 

= lim / 

x ^ x ° Jn 


l^(x) -y>(xo)| 
||x - x 0 || 2 
|^(x) -p(x 0 )| 


dx 0 

d± n 


ll X - X o II 2 

Since ip G C 1 (h2), then Holder continuity given by (2.2) is satisfied for 7 = 1, 
b(x) - v?(x 0 )| < k||x - x Q || 2 
which is Lipschitz continuity. Then (3.6) reads 


in 


||V<^(x 0 )|| 2 dx 0 < lim / Kdx 0 — h c|0|. 

x->x D J n 


(3.6) 


(3.7) 

□ 
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We formulate the last formulatin for this section which is an immediate consequence 
of this theorem. 


Corollary 3.5. Under the same conditions of Theorem 3.4, then, 

f ||Vv>Hi<te<fc 2 |Si| 2 . 


(3,8) 


in 


Proof. Again, by the definition of Euclidean norm in Section 2 by (2.1), 


IIV^IIl = 


d(p 


dx 


+ 


dip 


dy 


+ 


dip 


dz 


Analogous to the proof of Theorem 3.4, 


l|V^(x 0 )|||dx 0 < / lim 

n x->x 0 


= lim 


< n 2 \n \ 2 


|y?(x) -y?(x 0 )| 
ll x - x o|h 
|y?(x) -y?(x„)| 

|| x x o || 2 


d±n 


dx„ 


since <p(x) £ C 1 (Q). 


(3.9) 

□ 


4. Smoothed-TV Regularization Is an Admissible Regularization Strategy 
With the Holder Continuity 

We will define such a regularization parameter which will simultaneously enable us 
to prove the convergence of the smoothed-TV regularization and to estimate the 
dicrepancy || 7~p> — f s \\ for the corresponding regularization strategy, [10]. Unlike the 
available literature, [1, 3, 4, 8, 9, 10, 14, 15, 31], we define discrepancy principle for 
the smoothed-TV regularization under a particular rule for the choice of regularization 
parameter. Furthermore, still with the same regularization parameter, we manage to 
show that smoothed-TV regularization is an admissible regularization strategy with 
Holder continuity. Throughout this section, the fact that our targeted solution function 
is Holder continuous will be to our benefit to be able provide an implementable 
regularization parameter for copmuterized environment. Hereafter, the component x 
is replaced by x only for the sake of simplicity. 

To be able to show the convergence of ||<^a( 5 ) — <£h||, we will refer to Bregman 
divergence. In Proposition 2.2, we have demonstrated the relation between strong 
convexity and 2—convexity. Convexity of the smoothed total variation penalizer has 
been established in [1, Theorem 2.4], We will ensure the strong convexity of the same 
penalizer in the following formulation. 

Theorem 4.1. For any (3 > 0, the functional J(y?) f n \J\ [V^j || + f3dx is strongly 


convex. 
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Proof. It suffices to prove that V 2 J(v?) > 0. To avoid confusion in the calculations, we 
will make an assignment g(p) = a/N 2 + P where p = \7<p. According to Leibniz integral 
rule, calculating X7 2 J(ip) > 0 and g" (p) are equivalent to each other. Then 


9 ip) 


P 

Vp 2 + p’ 


and likewise 


9” ip) 


P 

{p 2 + (3 ) 3 / 2 ’ 


Obviously, g \p) > 0 for any (3 > 0. 


□ 

Theorem 4.2. Over the compact domain Pi C R 3 , assume that u,v E C 1 (h2) f^|C 0 ’ 7 (h2). 
Then there exists a dynamical positive real-valued functional K,(u ) : C 1 (h2) —> R + 
depending on u such that 


J(u) - J(v) < 2k 2 \Q\ 2 1C(u)\\X7(u - u)11 2 , 

for J(-) defined by J(-) = j Q \/||V(-)|| 2 + Pdx and where k satisfies (2.2) for 7 = 1 . 
Proof. By the definition of J(-) := J Q \/||V ■ ||| + f3dx, 


J(u) — J(v) = 


< 



Hv^lll - nv^lll 

(||Vu|| 2 + /3)V2 + (||Vu|| 2 + /3)V2 ' 


f HV^Ill - IIV^III 

Jn (l|Vu|| 2 + ^)V2 


Now choose U = minuend | Vw| 11} to have, 


(4.1) 


J(n) - J(v) < 1 /2 j((||V M ||^ - ||Vu |\\)dx 

= [U + 1 /?)1/2 /(||V„|| 3 - ||Vb|| 2 )(||Vm|| 2 + ||V«|| 2 )<fe 

< , u + L, /; J a (l|v« - V.||,)(||V U ||, + ||V„|| 2 )<fe. 

Apply Holder inequality to have, 


J(u) - j(v) < f „ n IIV 11 - VfllldO 7 (/(||V«|| J+ ||V.| W ’«fc) 

\ V2 / r \ 1/2 

||Vm - Vu ||Idxj [JjVuWl + \\\7v\\ 2 2 dx) 


< 


(u + fiy/ 2 















Regularity Properties of the Smoothed-TV 


11 


since 2ab < a 2 + b 2 for any a, b G M + . By Corollary 3.5, we have already obtained the 
upper bound for the second integral on the right hand side. Then, 


J{u ) — J(v ) < 


2k 2 \D\ 2 

(W + W /2 \Ja 

2a=c 2 |0| 2 


\ 1/2 

||Vu — \7v\\\dx ) 




||V( M -u)|| 2 . 


+ /3)V2' 

Hence, the positive real valued functional is defined by, 

1 


K(u) ■= 


(i U + (3 )V 2 ' 


□ 


An immediate consequence that we make use of C 1 + (f2) function space is formulated 
below. 

Corollary 4.3. Over the compact domain H c M 3 , assume that u,v G 
C 1 + (f2) p| C°’ 7 (h2). Then with the same functional fC[u) : C 1 + (f2) -A R + as appears in 
Theorem f.2, it is hold that 


J(u ) - J(v) < 2n 2 L u , v \n\ 2 JC(u), 

for J(-) defined by J(-) = f Q a/I I V(-) 11| + /3dx, where k satisfies (2.2) for 7 = 1 . 

Proof. Since u,v G C 1 + (h2), there there exists constant satisfying ||V(w — u )|| 2 < 
L u , v \\u — u|| 2 . Then it follows from the above calculations in the proof of Theorem 
4.2, 


J{u ) — J(v) < 


< 


2 n 2 \Tl\ 2 

(u + py / 2 

2k 2 \TI\ 2 

(U + P ) 1 ' 2 


||V(u-u )|| 2 

Ru,V I 1 V | | 2 . 


□ 


4-1. Discrepancy principle for the smoothed TV regularizer 

We are able to evaluate the fixed coefficient r in the discrepancy principle \\T<p a (s) ~ 
f 5 1| < t5 for the smoothed TV penalty J(-) in the problem (1.1). To do so, we need to 
assume that the target function to be class of C 1 + (f 2 ). 

Moreover, in order for a precise upper bound for \\'Tp a {S) — f 5 \\, we will need to 
focus on our specified penalty J(<p) f Q a/ 11Vy?11| + (ddx. The regularized solution 
Va( 5 ) to the problem (1.1) is the minimum of F((f) for all tp G D(T). Which is in other 
words, 
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Pa{5) e arg min^ 





f S \\c* + aJ(ip) 


Then 

i||r^ ({) - f\\h + <».%«(«) < jlir^t - /111. + aJ(7). (4.2) 

Since the true data p satisfying the operator equation Tp = P lies in some 5— ball 
Bs{f s ), i.e. || p — p\\ < 5 , then (4.2) reads, 

i||r^ (i) - f III. < p + - •%«(„)). (4.3) 

Further development of this estimation will be done by means of Theorem 3.4 as 
formulated below. 


Theorem 4.4 (Discrepancy principle for the smoothed-TV regularization). Over the 
compact domain D C R 3 , denote by <p a (S),P £ C 1+ (f2) f)C 0,7 (f2) the regularized and the 
true solutions to the problem (1-1) respectively. If the regularization parameter a(5) is 
chosen according to the rule of, 


a(S) < 5 2 


2 k 2 P \ 2 


(4.4) 


for n satisfying (2.2) with 7 = 1, and 

■= (u + j3 y/2 

where 


U = mindlV^Ha}, 

2 

then the discrepancy ||Ty3 a (<5) — P\\c 2 f or the smoothed-TV regularization is estimated 

by, 


II7>a(5) ~ P\\c 2 < 5yJ 1 + ||V(^ Q(a) - p)\\ 2 . 

Furthermore, if the regularization parameter fulfils 

(JCMY 


, -i 


a(<$) < 


2 k 2 \Q\ 2 L 


r>cc( 6 ),r>' 


where L v ^t is an appropriate Lipschitz costant then, 


(4.5) 


(4.6) 
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Proof. From the calculations in (4.3) and the quick adaptation of Theorem 4.2, it is 
firstly obtained that 


||7V« ( *) - f 5 \ib < d 2 + 2 a(J(<p a(s) ) - J(<p*)) 

< d 2 + 2«ac 2 |Q1 2 /C(^ (<5) )11V(^(,5) - ^)|| 2 . (4.8) 

Then, with the given rule of the regularization parameter a in (4.4), 

H7V« (i) -m* < i 2 + ^iiv(^, i) -y)i| 2 , 

which is the hrst result. It is not difficult to obtain the second part of the theorem. 
Analogous to Corollary 4.3, observe that there exists ^t such that 

J{p a {5)) - J(p ] ) < K 2 |fl| 2 /C(< / 9 Q ( 5 ))||V(( / 9 Q ( 5 ) - (f ] )\\ 2 

— ^ 1^1 K'(SPoL(S))Lip a (8):P I l^«(5) 7^1 |s (4-9) 

Then, from (4.8), 


l|7V«(*) - f 5 \\c 2 <#* + 2 «« 2 | fi | 2 ^(^a(<5)) L ^ W ^t||^a(5) “ <P%- (4.10) 

Hence, with the given rule for choice of the regularization parameter a in (4.6), the 
second desired result yields. □ 

Uniform continuity of the smoothed-TV regularization will come from formulating 
another useful Bregman divergence which will lead us to the ultimate result of this work. 
Before proceeding, it must be noted that the discrepancy principle for the smoothed TV 
is yet to be completed in (4.7) which is necessary in order for fulfilling the condition in 
(1.3). The completion will follow after quantifying the rate for ||<^ Q (< 5 ) — 

Theorem 4.5. Under the assumptions of Theorem f.f, if the regularization parameter, 
for 6 G (0,1), satisfies 


a(S) < 5 




1 


which is analogous to (4-6) in Theorem f.f, then 


|| 7 V(< 5 ) — </?' 11 2 —* 0, as a(h) —* 0 whilst <5 —>■ 0 . 
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Proof. Since we will prove the assertion depending on the choice of the regularization 
parameter, then we formulate another Bregman divergence associated with the 
functional aJ(-). Moreover, it is clear that first order optimality conditions in (1.4) 
must also be hold for the true solution </A Then, 

D a j(Pa(S),^) = aJ{p a ^) - aJ(p ] ) - {aS7J{p ] ),p a ( S ) - p ] ) 

= a (J(<Pa(6)) - J(p f )) - (' T(f 5 - T(p*),(p a (S) -V)(4.11) 

Again, from the calculations in (4.3) and by Theorem 4.2, there exists Lipschitz constant 
L Va(s) ,P such that 

Daj{Pa(S)i P^) — l^h^'(¥ , o(5) )^- J ‘P a (,S):P I \Pot{S) I 2 T <f| \T\ \ \ \Pa(5) P^ 

By the given choice of regularization parameter rule (4.11), it is concluded that 

D a j{<Pa{S),<P*) < S\\Pa{5) ~ + 5| \T*\ \\ \p a ( 5 ) ~~ P^W (4.12) 

Hence, by 2—convexity in (2.7) and strong convexity of the smoothed TV penalty (see 
Thrm 4.1), 

11 Petes') ~ p' 11 2 < 6 + ||T*||^ —> 0, as ck(< 5) —* 0 whilst 5 —» 0 . (4.13) 

□ 

Corollary 4.6 (Final discrepancy estimation for the smoothed-TV regularization). 
Under the same assumptions of Theorem f.5, if the regularization parameter is chosen 
with respect to the rule 


a{5) < 5 


(K(y«w) r 1 

2K 2 |Ji| 2 L 


i Pa(S)i t P 


for S G (0,1) sufficiently small, then by (f. 6 ), 


/o \i/2 

lir^( j) -/ < iL»<u- + |ir , ||) . 


Proof. In the proof of Theorem 4.5, we have observed 


(4.14) 


(4.15) 


l|7>„(j)-/ || £ 2 < 5- + 2<m |Q| K.(<p a <,s))L Vam , v A\VaV) (4.16) 

After plugging (4.14) in, 
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||7> q( 5) - f s \\ 2 C 2 <5 2 + 5\\tp a ( S ) - (p%. (4.17) 

Recall the rate of the convergence for ||<^ a (< 5 ) — P '\\2 when the choice of regularization 
parameter fulfils the condition (4.14), which is 

II 7V„ (S ) - f \\% < s 2 + s 2 (^ + dr'll) = s 2 Q + dr'll). 

This yields the result after taking the square root of both sides. 

□ 


Conclusion and Further Discussion 

Holder continuous functions in the application arises in the field of scattering theory, 
see for details [12, Section 8.2] and a recent work [23, Lemma 2.2], In this work, we have 
explored the regularity properties of the smoothed-TV regularization for such functions. 
The scientific reason why smoothed-TV regularization has been chosen for such a study 
has been established in Theorem 3.3. 

In Theorem 3.4, we have proved that TV of a function ip can be bounded by its 
Lipschitz constant k which is the case of 7 = 1. However, it is still an open question to 
be able to show that 

TV(<p) <C(QM c o, Hn) 

where C(h2) is a constant depending on the compact domain H C M 3 and 7 = 1/4 
due to Morrey’s inequality, see Theorem 3.1. Then a new compact embedding theorem 
between the spaces BV (fl) and C 0 , 7 (h2) can be established. On the other hand, compact 
embedding amongst the Holder spaces with the different orders has already been proven, 
[12, Theorem 3.2], 

Speaking about proving that smoothed TV regularization is another admissible 
regularization strategy, we have intentionally taken into account that the forward 
operator is compact. The reason behind that can be explained as follows; Application 
and analysis of the method has been widely carried out in the communities of inverse 
problem and optimization, [1, 3, 4, 8 , 9, 10, 14, 15, 31]. It is well-known that the efficient 
result of TV (or smoothed TV) regularization usually comes from image processing 
where the compact operator is mostly considered to be identity operator, i.e., T = X. 
Lagged diffusivity fixed point iteration is the easiest algorithm in order to approximate 
the solution for the problem (1.1), [10, 30, 31]. The convergence of this algorithm has 
been shown only for the case of T — X, [2, 10]. Following the same steps in the regarding 
works, we also define the following continuous nonlinear transformation 

-(-“W v, '(wv7VFv) +r ' T )- 


^*(Wo(5)) ' 


(4.18) 
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According to the regarding works, the algorithm is convergent in the condition of 
Amin i'P{ i P'p a (6))) — A 1. Obviously, this can not hold for us since our forward 

operator T is compact. A tomographic application of total variation regularization with 
some compact toward operator has been recently studied in [21]. 
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